Abstract

OBJECTIVE: To identify or develop a critical appraisal instrument (CAI) to aid in the selection of search filters for use in systematic review searching. The CAI is to be used by experienced searchers without specialized training in statistics or search filter design. METHODS: Through extensive searching and consultation, one candidate instrument was identified. Through expert consultation and several rounds of testing, the instrument was extensively revised to become the Canadian Agency for Drugs and Technologies in Health (CADTH) CAI. RESULTS: The CADTH CAI consists of ten questions and can be applied by experienced searchers with a moderate knowledge of search filter methodology. CONCLUSION: The CADTH CAI provides experienced searchers with a means of selecting the search filter that is most methodologically sound.
Hide

Abstract

OBJECTIVES: The authors developed a tool to assess the quality of search filters designed to retrieve records for studies with specific research designs (e.g., diagnostic studies). METHODS: The UK InterTASC Information Specialists' Sub-Group (ISSG), a group of experienced health care information specialists, reviewed the literature to evaluate existing search filter appraisal tools and determined that existing tools were inadequate for their needs. The group held consensus meetings to develop a new filter appraisal tool consisting of a search filter appraisal checklist and a structured abstract. ISSG members tested the final checklist using three published search filters. RESULTS: The detailed ISSG Search Filter Appraisal Checklist captures relevance criteria and methods used to develop and test search filters. The checklist includes categorical and descriptive responses and is accompanied by a structured abstract that provides a summary of key quality features of a filter. DISCUSSION: The checklist is a comprehensive appraisal tool that can assist health sciences librarians and others in choosing search filters. The checklist reports filter design methods and search performance measures, such as sensitivity and precision. The checklist can also aid filter developers by indicating information on core methods that should be reported to help assess filter suitability. The generalizability of the checklist for non-methods filters remains to be explored.
Hide